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SPECIFICATION 
TITLE 

"METHOD FOR PRODUCING AN IMAGE" 
BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to a method for producing an image from a 
three-dimensional image of a subject. 
Description of the Prior Art 

Images that are picked up with modern imaging medical devices have a 
relatively high resolution in all directions, and therefore amplif i ed more and more 3D 
projections acquisitions (volume datasets) are g e n e rat e d performed with them. 
I mag i ng m e d i ca l Medical Imaging devices include ultrasound devices, computed 
tomography devices, magnetic resonance devices or X-ray devices or PET 
scanners, for example. Computed tomography or X-ray devices nowadays can more 
frequently a l so fr e qu e nt l y be utilized, because the radiation tea4 dose to which a 
living being is exposed during an examination with one of these devices has 
decreased. Volume datasets however contain a larger amount of data than image 
datasets of conventional two-dimensional images, which is thereon why an 
evaluation of volume datasets is relatively time-consuming. The actual pick-up of the 
volume datasets currently takes approximately half a minute, but it frequently takes 
half an hour or more to search through and edit the volume dataset. Methods for 
automatic recognition and editing are needed and desirable. 

Furthermore, it may occur that fine structures are submerged, particularly in 
the representation of large volume datasets, i.e. contrast agents may b e are needed 
in order to make such fine structures visible. This is true of the representation of 
small vessels , for example . 
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Until the year 2000, it was customary practice in computed tomography (CT) 
to reach a diagnosis based almost exclusively on axial slice stacks (slice images) or 
at least to focus base findings predominantly on the slice images. Since 1995, due 
to the power of new computers, 3D representations on diagnostic consoles have 
been widespread; initially they had a scientific or ancillary importance. Essentially 
four basic methods of 3D visualization were developed in order to facilitate diagnosis 
by a physician: 

1. Multiplanar reformatting (MPR): This is no mor e than just a reconfiguration 
of the volume dataset in [[a]] different orientation from ^ the original view of 
horizontal slices. It basically breaks down into orthogonal MPR (three MPRs, 
respectively perpendicular to a coordinate axis), free MPR (oblique slices; d e rivativ e 
derived = interpolated) and curved MPR (slice representation parallel to an arbitrary 
path through the image of the body of the living being and e.g. perpendicular to the 
MPR in which the path was drawn). 

2. Shaded Surface Display (SSD): segmenting the volume dataset and 
representing the surface of the subj e ct object that is be i ng cut has been identified , 
usually strongly influenced by orienting at on the CT values and manual help 
auxiliary editing. 

3. Maximal Intensity Projection (MIP): representation of the highest intensity 
along each ray. In what is known as thin MIP, only a sub-volume is represented. 

4. Volume rendering (VR): encompasses modeling of the attenuation of the 
eve ray that penetrates the subject in a similar manner as an X-ray. The entire depth 
of the imaged body (partly translucent) is captured; however, details of small and 
abov e a l l especially thin-sliced subjects are lost. The representation is i nfluoncod 



2 



MARKED COPY 

adjusted manually by the setting of what ar e known as so called transfer functions 
(color lookup tables). 

Another important technique for rapid visualization, which is not actually a 3D 
method, is film - typ e movie-like immersion m down into a slice stack m of which one 
slice after the other is repres e nt e d displayed . 

United States Patent No. 4,879,652 describes a method for a special shaded 
representation of a subject that is imaged in a volume dataset. The volume dataset 
is produced with a nuclear medical device. 

United States Application Publication 2002/0164061 and United States Patent 
No. 5,425,407 describe methods for recognizing contours that are imaged in a 
medical image. 

SUMMARY OF THE INVENTION 

An object of the present invention is to provide a method that produces an 
imag e al l ow i ng th e r e pr e s e ntation of th e i mage that i s stored i n th e vo l um e datas e t 
to bo i mproved. Improved representation of image contents of volume datasets. 

This object is achieved in accordance with the invention by a method for 
producing an image including the steps of i n a comput e r storing a three-dimensional 
image of an object as a volume dataset, computerized s e gm e nt i ng segmentation of 
the curved surface of [[a]] the stored three-dimensional image of a subject the object 
storing th e thr ee- dim e nsiona l i mag e i s stor e d with a vo l um e datas e t, transforming 
the volume dataset so that the segmented curved surface is transformed into a 
plane, and representing the curved surface of the three-dimensional image 
subsequent to its transformation into a plane with a slice of predetermined thickness 
inside and/or outside the three-dimensional image. 
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With the inventive method, an intensive search through the complete volume 
dataset for specific queries can be automated and thus simplified and accelerated for 
the physician. With the inventive method, a type of "curved MIP" is created; i.e., a 
complex reformatting of the image contents of the volume dataset is performed. This 
occurs parallel to the segmented surface of the three-dimensional imag e image of an 
object rather than perpendicular to a plane and parallel to a line like in curved MPR. 

First, the surface of the three-dimensional image is automatically d e t e rm i n e d 
defected (segmented-ettf). This typically curved surface is then transformed into the 
plane as if the three-dimensional image were to be unrolled. The projection of the 
surface of the earth on maps is an analogy . Particularly when the subject is the 
torso of a living being which has a quasi-columnar shape with an approximately 
elliptical base, the surface can be unrolled into a flat area. 

If the three-dimensional image takes the form of consecutive computed 
tomography slice images, and the image data of each slice image are described in 
Cartesian coordinates (e.g. representation of tissue or structures near the skin along 
body surface (e.g. the shim) or along a tubular a ho l low bone), as in a preferred 
embodiment of the invention, then the segmenting segmentation of the surface of the 
three-dimensional image can be as follows. 

A coordinate transformation is performed for each slice image to polar 
coordinates relative to a line that extends through the three-dimensional image and 
is oriented at least substantially at a r i ght ang l e perpendicular to the individual slice 
images. The contours that are imaged in each transformed slice image are 
determined and allocated to the surface of the three-dimensional image. The pixels 
of the contours that have been determined are transformed back into the coordinate 
system that is allocated to the volume dataset. Pixels are -re-extracted along the 
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contours for the r e pres e ntation display of the surface, aft e r its transformat i on i nto th e 
p l an e , of th e thr ee- d i m e ns i ona l i mag e with tho s l ice of predetermined slice thickness 
inside and/or outside the three-dimensional i mag e contours . 

The ro ll ed unrolled flat representation of the surface of the three-dimensional 
image comprises a slice of predetermined thickness below and/or above the surface. 
The thickness equals several millimeters when blood vessels are being examined, 
for example. In the examination of the structure of hol l ow bon e s tubular structures , 
the thickness may equal almost a centimeter, and in an examination of the 
meninges, the slice is again relatively thin. In this hemispherical configuration, there 
is a close resemblance to cartographic projection, or a strip shaped reorganization is 
possible in the sense of the article "Volume Rendering" (R. Drebin, Computer 
Graphics 22 (4), August 1988: 65-74). 

For the slice of predetermined thickness of the generated image plane, 
depending on the problem, a reasonable computation technique is applied for the 
pixels arranged one behind the other, depending on the requirements of the 
representation. Margin conditions afe at a variable or constant spacing of the 
structure of the surface being searched for, noise that may have to be suppressed, 
the characteristic that a structure has a higher density than the environment (vessels 
[[(]]filled with contrast agent), calcifications), or some other feature (higher-order 
statistics). Because only the image of the surface and the imaged slice of 
predetermined thickness are represented, contrast is gained. 

According to a preferred variant of the invention, the three-dimensional image 
is an image of at least part of a living being, and the segmented surface is the image 
of the body surface of the imaged living being. 
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The image of the body surface of the living being or images of slices near the 
skin to defined depths can be automatically represented. Possible applications 
include preparation for plastic surg e r i es surgery , preparation for vascular surgery, 
melanoma screening, and many more applications. For instance, it is possible to 
render high-resolution representations of the subcutaneous vascular tree. 

The inventive method is not limited to the body surface (skin); rather, a further 
embodiment of the invention provides that the subject is a bone or organ of a living 
being. Thus, the surface of a deeper organ or a boundary surface within an organ 
can be examined. Bone examinations (condition of trabecula) for evaluating the 
growth or decay (in osteoporosis) are also possible applications. 

In order to obtain different views of the transformed surface, embodiments of 
the invention provide that the transformed plane is oriented in the line of sight into 
the three-dimensional image and/or the line of sight away from the three-dimensional 
image. The surface being examined , that i s to say, or its image, respectively, can 
thus be examined from different tines points of view. 

For different representations of the slice of predetermined thickness, the 
image data that are allocated to the slice of predetermined thickness can be 
represented by means of MPR (multiplanar reformation), MIP (maximal or minimal 
intensity projection), volume rendering (VR) and/or filtering (smoothing, edge 
accentuation or otherwise structure accentuation). 

DESCRIPTION OF THE DRAWINGS 

Figure 1 is a computed tomography apparatus operable in accordance with 
the invention. 

Figure 2 is a three-dimensional image of the ventral area of a patient in the 
form of a volume dataset consisting of several slice images. 
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Figure 3 is a slice image of the volume dataset represented in Figure 2. 

Figure 4 shows image information, after transformation to polar coordinates, 
of the slice image represented in Figure 3. 

Figure 5 is an image dataset representing the image of the body surface after 
transformation into a plane and an image of a slice adjacent the body surface. 

Figure 6 is the image that is ollocatod to an embodiment of the image dataset 
shown in Figure 5. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Figure 1 is a schematic representation of a computed tomography apparatus 
with an X-ray source 1 which emits a pyramidal X-ray beam 2 A the peripheral rays of 
which are represented as dotted lines in Figure 1, which passes through an 
examination subject, for instance a patient 3, and strikes a radiation detector 4. This 
X-ray source 1 and the X-ray detector 4 are disposed facing one another on opposite 
sides of an annu l ar circular gantry 5. The gantry 5 is supported by a bearing device 
that is not shown in Fig. 1, such that it pivots relative to a system axis 6 that extends 
through the midpoint of the annular gantry circular 5 (arrow a). 

In the exemplary embodiment, the patient 3 lies on a table 7 that is 
transparent to X-ray, which is supported by means of a bearing device that is not 
shown in Figure 1 in such a way that it can be displaced along the system axis 6 
(arrow b). 

The X-ray source 1 and X-ray detector 4 form a measuring system which is 
rotatable relative to the system axis 6 and displaceable along the system axis 6 
relative to the patient 3, so that the patient can be irradiated at different projection 
angles and different positions relative to the system axis 6. From the generated 
output signals of the radiation detector 4, a data acquisition system 9 forms 
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measurement values, which are fed to a computer 11, which computes, by methods 
known to those skilled in the art, an image of the patient 3 that can be reproduced on 
a monitor 12 that is connected to the computer 11. In the exemplary embodiment, 
the data acquisition system 9 is connected to the radiation detector 4 by an electrical 
line 8, which terminate in a wiper ring system, or a wireless transmission path, to 
obtain signals from the radiation detector 4, and is connected to the computer 1 1 by 
an electrical line 10. 

The computed tomography apparatus shown in Figure 1 can be utilized for 
sequential scanning and spiral scanning. 

In sequential scanning, the patient 3 is scanned slice by slice. The X-ray 
source 1 and the X-ray detector 4 are rotated around the patient 3 relative to the 
system axis 6, and the measuring system, which includes the X-ray source 1 and the 
X-ray detector 4, captures a number of projections in order to scan a two- 
dimensional slice of the patient 3. From the measurement values so acquired, a 
slice image representing the scanned slice is reconstructed. Between the scanning 
of consecutive slices, the patient 3 is moved along the system axis 6. This process 
is repeated until all relevant slices are picked up. 

During a spiral scan, the measuring system formed by the X-ray source 1 and 
the X-ray detector 4 rotates relative to the system axis 6, and the table 7 moves 
continuously in the direction of arrow b; that is, the measuring system comprising the 
X-ray source 1 and the X-ray detector 4 continuously moves on a spiral path c 
relative to the patient 3 until the region of interest of the patient 3 is completely 
covered. A volume dataset is thereby generated, which is coded according to the 
customary DICOM standard in the present embodiment. 
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In the exemplary embodiment, a volume dataset of the ventral area of the 
patient 3 consisting of several consecutive slice images is generated with the 
computed tomography apparatus represented in Figure 1. The volume dataset that 
is represented schematically in Figure 2 comprises approximately 250 CT slices 
(slice images) of the matrix 512x512. Figure 2 shows seven slice images as an 
example, which are indicated by reference characters 21 to 27. 

In the exemplary embodiment, the body surface that is imaged with the 
volume dataset and the imaged tissue and imaged vessels immediately beneath it 
are represented. To that end, in the exemplary embodiment, a suitable computer 
program runs on the computer 1 1 , which executes the steps described below. 

First, for determining the imaged body surface, each slice image 21 to 27 of 
the volume dataset is transformed to polar coordinates (r,<p) relative to a line G 
through the three-dimensional image of the stomach region of the patient 3 in a first 
pass. The line G is oriented at least substantially perpendicular to the individual slice 
images 21 to 27. In the exemplary embodiment, the line G extends through the 
center of the volume dataset and corresponds to the z-axis of the coordinate system 
that defines the volume dataset. 

In the exemplary embodiment, each slice image 21 to 27, of which the slice 
image 21 is exemplarily represented in Figure 3, is described with Cartesian 
coordinates (x,y). Next, the image information of each slice image 21 to 27 is 
rearranged radially, being transformed to polar coordinates (r,cp) relative to the line 
G, i.e. relative to the respective point of intersection between the line G and the 
corresponding slice image. As an example, the point of intersection S between the 
line G and the slice image 21 is represented in Figure 3. With the transformation to 
polar coordinates (r,cp), the image of the body surface of the patient 3 is also 
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transformed, being represented as a closed contour in each transformed axial slice 
(slice image). Figure 4 represents an example of a contour 41 that i s a ll ocat e d 
corresponds to the image of the body surface of the patient 3 for the slice image 21 
subsequent to its transformation to polar coordinates (r,cp). 

The result of the transformation to polar coordinates (r,cp) is a linearly mapped 
radial brightness profile. In this rectangular matrix ( d e r i vat i v e extracted image 
matrix), a filtering is performed, which accentuates the contours that are allocated to 
the body surface, such as the contour 41 represented in Figure 4. The filter 
responses replace the brightness values in the d e rivat i v e extracted image matrix. 
Next is the search for the optimal path in this image matrix from top to bottom at the 
identical start point/end point. In the exemplary embodiment, this occurs by means 
of dynamic optimization, such as described in Dynamic programming and stochastic 
control processes Programming and Stochastic Control Processes (R. Bellmann, 
Information and Control 1(3), September 1958: 228-39). The optimal path 
represents the radial vectors to the body surface pixels. In a further step, the 
contours 41 that have been transformed to polar coordinates are transformed back 
into the original coordinates of the volume dataset, so that the whole contour 
ensemble that is determined from the individual contours of the slice images 21 to 27 
and the corresponding pixels of the original volume dataset are checked in relation to 
the individual contours across all slice images 21 to 27. This contributes particularly 
to the suppression of errors ( outli e rs overshoots ) and to reliability. At the probable 
points of error, r e segment i ng re-segmentation is performed in the individual slice 
images 21 to 27, with subsequent checking of the 3D context. The image of the 
patient 3 in the volume dataset i s thus has thus been segmented. 
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In the exemplary embodiment, this is followed by a re-extraction at a right 
angle to the image of the segmented body surface in the volume dataset. Whereas, 
in the transformation to polar coordinates (r,cp), brightness profiles were computed 
from the original data at a right angle to all points of a circle (idealized surface 
contour) and mapped as a rectangular matrix, in the re-extraction, profiles are 
obtained at each pixel of the image of the segmented body surface (body surface 
contour) at a right angle to the surfac e gradi e nt deflected surface . This re-extraction 
is remapped as a rectangular matrix. A p e rpend i cu l ar vertical line th e r ei n herein , for 
instance the centerline, corresponds to the pixels of the image of the body surface. 
For example, at le ft i n Figur e 6 to the left of this vertical line are the CT measurement 
values near the body surface on the inside. The volume dataset is thus transformed 
such that the segmented image of the body surface of the patient 3 is transformed 
into a plane. Thus, depending on the problem, a slice below and/or above the 
segmented surface that has been transformed into a plane — in the exemplary 
embodiment, the segmented and transformed image of the body surface of the 
patient 3 — is calculated for measurement value determination (re-extraction). The 
thickness of this slice tt |s entered into the computer 1 1 prior to s e gmentat i on re- 
extraction in the case of the present exemplary embodiment. As a result, an image 
dataset 51 emerges as represented in Figure 5, which has the structure of a thin 
voxel cuboid. 

In the exemplary embodiment, the thickness of the slice adjacent the body 
surface is some 5 mm.[[.]] It is thus possible that, in the exemplary embodiment, 
vessels situated just below the skin of the patient 3 in the groin area can be 
represented without contrast agent. Above this thickness of 5 mm, the highest 
density is computed perpendicular to the body surface, and a thin MIP is generated, 
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but, with reference to the original volume data, along the curved image of the body 
surface. For an evaluation, the image dataset 51 that is represented in Figure 5 can 
be utilized, the corresponding image 61 of which is represented in Figure 6 and 
displayed on monitor 12. 

The minimum can be utilized instead of the maximum signal value, or some 
other calculation can be performed for other problems. For relatively thick 
structures, for example, an improvement of the signal/noise ratio can be achieved 
with the aid of an average formation or some other smoothing operator. With the 
selection of a narrow band of signal values (e.g. Hounsfield units), it is possible to 
select structures with particular characteristics (e.g. blood vessels, calcifications etc.) 
or to fade such structures out in complementary fashion. 

With analysis in the plane parallel to the orientation surfac e plane (Figure 5), 
the measurement values can be analyzed and visually displayed in the "horizontal" 
context of their surfac e plane (e.g. in their texture characteristics). 

In the exemplary embodiment, the volume dataset is produced with a 
computed tomography apparatus. For the inventive method and the inventive 
medical device, the volume dataset can also be produced with some other imaging 
device, such as a magnetic resonance device, X-ray device, ultrasound device, or 
PET scanner. The volume dataset need not take the form of several consecutive 
computed tomography slice images. 

The image that is to be segmented need not be the body surface of a living 
being. In particular, the inventive method is suited for images of near any surfaces^ 
of organs or bon e s as w ell . With special respect to surfaces of organs, vessels or 
bones 
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Although modifications and changes may be suggested by those skilled in the 
art, it is the intention of the inventor to embody within the patent warranted hereon all 
changes and modifications as reasonably and properly come within the scope of his 
contribution to the art. 
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